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ABSTRACT 

Background: it is increasingly recognised that 
patients can play a role in reporting safety incidents. 
Studies have tended to focus on patients within 
hospital settings, and on the reporting of patient safety 
incidents as defined within a medical model of safety. 
This study aims to determine the feasibility of collecting 
and using patient experiences of safety as a proactive 
approach to identifying latent conditions of safety as 
patients undergo organisational care transfers. 
Methods and analysis: The study comprises three 
components: (1) patients' experiences of safety relating 
to a care transfer, (2) patients' receptiveness to 
reporting experiences of safety, (3) quality improvement 
using patient experiences of safety. (1) A safety survey 
and evaluation form will be distributed to patients 
discharged from 15 wards across four clinical areas 
(cardiac, care of older people, orthopaedics and stroke) 
over 1 year. Healthcare professionals involved in the 
care transfer will be provided with a regular summary of 
patient feedback. (2) Patients (n=36) who return an 
evaluation form will be sampled representatively based 
on the four clinical areas and interviewed about their 
experiences of healthcare and safety and completing the 
survey. (3) Healthcare professionals (n=75) will be 
invited to participate in semistructured interviews and 
focus groups to discuss their experiences with and 
perceptions of receiving and using patient feedback. 
Data analysis will explore the relationship between 
patient experiences of safety and other indicators and 
measures of quality and safety. Interview and focus 
group data will be thematically analysed and triangulated 
with all other data sources using a convergence coding 
matrix. 

Ethics and dissemination: The study has been 
granted National Health Service (NHS) Research Ethics 
Committee approval. Patient experiences of safety will 
be disseminated to healthcare teams for the purpose of 
organisational development and quality improvement. 
Results will be disseminated to study participants as 
well as through peer-reviewed outputs. 



Strengths and limitations of this study 



A strength is that the study will demonstrate 
how, or if, routinely collected data on patient 
experiences of safety during an organisational 
care transfer is linked to other measures and 
indicators of quality and safety. 
A unique feature of the investigation will be how 
patient feedback on safety promotes organisa- 
tional learning within multiple healthcare provi- 
ders when patients' care crosses healthcare 
boundaries. 

Challenges include engaging patients to report 
on their experiences of safety, and engaging 
healthcare professionals to distribute surveys 
and use feedback for quality improvement. 



BACKGROUND 

Patient safety has received much attention 
since the publications of An Organisation with 
a Memory^ in the UK and To Err is Humari' in 
the USA at the turn of the century. Since 
then, there has been a particular emphasis on 
identifying patient safety incidents, broadly 
defined as an incident that harmed or had the 
potential to harm a patient.^ The most prom- 
inent approach to identifying unsafe care is 
the use of incident reporting, where health- 
care professionals are required to identify and 
report on safety incidents.^ However, there 
have been a number of criticisms of healthcare 
professional incident reporting, with health- 
care professionals not engaging with incident 
reporting due to a myriad of cultural issues^ 
and subsequently under-reporting incidents.^ ^ 
This is of particular importance to care trans- 
fers between organisations, which are acknowl- 
edged to be especially high in risk^^^ and are 
often haphazard/^ 
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When willing and able/^ patients are believed to have 
a role in improving their own safety during care trans- 
fers, which includes the identification and reporting of 
their own safety^"^ and increased involvement in the 
handover process itself/^ Recent reports in the UK, 
such as the Francis Inquiry^ ^ and the report by Donald 
Berwick, indicate that patients should be involved at 
all levels in their own safety. This involvement falls into 
three categories: informing a management plan, moni- 
toring and ensuring safe delivery of treatment and 
making systems safer, the latter of which includes 
reporting on experiences of safety. 

Patients differ from healthcare professionals in their 
perceptions of safety,^^"^^ and these differences need to 
be addressed. By involving patients in their own safety, 
healthcare professionals can encourage them to act as 
an extra safeguard within the healthcare system, in 
line with the systems approach to safety.^ Where the defi- 
nitions of safety differ between the patient and health- 
care professional, it is only the patient who can identify 
and report on feeling unsafe in relation to their own 
definition of safety. 

As such, the aim of this study is to determine the feasi- 
bility of implementing a patient safety survey which will 
measure patients' experiences of their own safety relat- 
ing to care transfer, in particular the discharge, journey 
and arrival stages of the transfer. In order to achieve this 
aim, specific objectives include: 

1. Measurement of experiences of safety relating to a 
care transfer following discharge from hospital, 
including a comparison of how these experiences 
relate to current measures and indicators of safety 
(readmission rates, length of stay, Datix reports on 
patient experience and safety thermometer data) . 

2. Determining response rates and investigating the 
receptiveness of patients to the reporting tool, includ- 
ing the applicability of the domains of safety 
measured. 

3. Investigating the engagement and responsiveness of 
healthcare teams to the reporting tools and reports 
of safety, and the promotion of organisational 
learning. 

METHODOLOGY 

Appreciative Inquiry (AI) is a methodological approach 
to research and organisational development that focuses 
on 'what works well' in an organisation, as opposed to 
what does not work.^^~^^ It has been acknowledged that 
trends in adverse events do not appear to be improv- 
ing,^^ and there is an increasing emphasis, particularly 
in proactive approaches to safety management, that 
effective safety management requires identifying and 
measuring 'safety', as opposed to 'unsafe ty'.^^ Utilising 
principles of AI provides a methodological basis for the 
focus on 'safe', as opposed to 'unsafe' care. The involve- 
ment of patients in this proactive approach with an 
emphasis on safe care provides a radical alternative to 



existing methods of measuring safety. By taking this posi- 
tive approach, AI has the ability to engage healthcare 
professionals by shifting the focus from problems to 
solutions. 

METHODS 

The study will investigate patient reports of safety follow- 
ing a care transfer, which will include the discharge 
process, the journey and the arrival or admission process at 
the following organisation. The safety surveys will be dis- 
tributed to patients discharged from wards in four clin- 
ical areas: cardiac, care of older people, orthopaedics 
and stroke. These clinical areas were chosen in consult- 
ation with patient safety teams at the research sites so as 
to focus on clinical areas predominantly associated with 
older patients who are at increased risk of safety inci- 
dents^^ and are recognised as high priorities. 
Furthermore, the safety survey was originally developed 
based on older patients' perceptions of safety in care 
transfers. 

Study design 

The study will utilise a mixed methods approach, with 
qualitative and quantitative data collected across three 
components of the study. The three components reflect 
the objectives of the study, and include (1) patients' 
experiences of safety relating to a care transfer, (2) 
patients' receptiveness to reporting experiences of safety 
and (3) quality improvement using patient experiences 
of safety (figure 1). 

Qualitative methods will supplement quantitative data 
collected from the safety surveys, which will provide an 
understanding of the processes involved in learning 
from the patient feedback, potentially leading to quality 
improvement. The survey results will be made available 
to clinicians, thus allowing them to take a proactive 
approach to safety. This will consist of implementing a 
bi-weekly feedback loop between the research team and 
healthcare professionals involved in the transfer of 
patients. The feedback will be provided bi-weekly in the 
form of a clinical dashboard collated from the safety 
surveys representing three categories: patients within 
their own healthcare unit, patients within their clinical 
area and patients across the study (unidentifiable 
outside of their healthcare unit; figure 2) . 

Safety survey for organisational care transfers 

The safety survey was developed by healthcare profes- 
sionals and expert patients. It provides a brief explan- 
ation of patient safety and captures patient reports of 
safety across three stages of the care transfer {discharge, 
journey and arrival or admission) . The questions asked in 
each stage of the care transfer are provided in table 1, 
and focus around six domains: communication, responsive- 
ness, waiting times, falls, medication and hygiene. These 
domains are based on patient perceptions of safety. 
Patients or their carers are asked to report on three 
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Distribution of safety survey 

Safety Survey distributed to patients (n= 
approx. 14,000) at point of discharge from 
wards (n=15) 



► Survey responses 

► Readmission rates, length 
of stay, Datix reports of 
safety, safety thermometer 
data 



Ol 
O 



Component 2: Patients' 
receptiveness to reporting 
experiences of safety 



Component 3: Quality 
improvement using patient 
experiences of safety 



► Patient interviews (n=36) 

► Response rates 

► Evaluation forms 



► Ward staff interviews/ focus groups (n=90) 

► Healthcare professional interviews 
(involved in journey or arrival / admission; 
n=15) 




Mixed methods analysis 

• Convergence coding matrix combining all 
three components 



Figure 1 Flowchart demonstrating how the components of the study interlink. 



levels of safety: safe (green), neutral (yellow) and unsafe 
(red), and to leave any non-applicable sections blank. 

The safety survey asks patients or carers the mode of 
transport for the journey and the arrival destination. 
Respondents are also asked if there was another reason 
they felt safe or unsafe and if anything could have been 
done to make the patient feel safer; the safety survey 
gives space to explain their answers to these questions. 
The survey also provides patients or carers with the 
contact details of the lead researcher, so that patients 
can ask questions about the survey. 



Study setting 

Surveys will be distributed by ward staff in three hospitals 
across two National Health Service (NHS) trusts. The 
four clinical areas will be represented across 15 wards: 
cardiac (n=3), care of older people (n=4), orthopaedics 
(n=4) and stroke (n=4). Distribution of numbered 
surveys by ward staff means that it is known where the 
patient has been discharged from. During the course of 
the study, the safety surveys will be used to map how 
patients are transported {journey) and who their care is 
handed over to ( arrival or admission) . 



Delivery of care 

Discharge /Journey / Arrival 



Organisational 
learningand quality 
improvement 




Summary of feedback 
provided to 
healthcare teams 

Bi-weekiy feedback 



Patient feedback on 
experiences of safety 

Returned to research team 



Figure 2 Process of feedback to healthcare teams, 
organisational learning and quality improvement. 



Component 1: patients' experiences of safety relating to an 

organisational care transfer 

Objective 

Measurement of experiences of safety relating to a care 
transfer following discharge from hospital, including a 
comparison of how these experiences relate to current 
measures and indicators of quality and safety. 



Method 

Patients will be provided with a safety survey on dis- 
charge from hospital. Surveys are a commonly used 
method of capturing feedback from patients on a wide 
number of healthcare topics. Of relevance to this study 
are patient experience surveys and patient safety surveys, 
with the latter currently the most reported method of 
capturing patient reports of safety.^^ Routinely col- 
lected data relating to measures and indicators of quality 
and safety will also be collected. 
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Table 1 Questions asked in the safety survey about the different stages of the care transfer 
Please tick which of the following affected how safe or unsafe you felt 



Discharge 



Journey 



Arrival or admission 



Communication from staff 
Staff listening to you 
Departure running to schedule 
Falling or potential falls 
Medication problems or concerns 
Hygiene 



Communication from staff 
Staff listening to you 
Journey running to schedule 
Falling or potential falls 
Medication problems or concerns 
Hygiene 



Communication from staff 
Staff listening to you 
Waiting times 
Falling or potential falls 
Medication problems or concerns | 
Hygiene 



Please use this space to tell us if there was another reason why you felt safe or unsafe or to expand on your answers above. 
What could we have done to make you feel safer during your transfer? 



Sample 

All patients discharged from the included wards, or 
their carers, will be given a safety survey by ward staff. 
Owing to the nature of the wards, it is not anticipated 
that this sample will include any patients under the age 
of 18. As all patients will be given the safety survey, no 
power calculation was conducted; instead response rates 
will be monitored to inform feasibility for the universal 
invitation for patients to provide feedback on their safety 
in the setting of care transfers. It is estimated, based on 
discharge information from the sites, that the safety 
survey will be distributed to 14 000 patients over a 
12-month period. Routinely collected data will consist of 
readmission rates, length of stay, Datix reports on 
patient experience and safety thermometer data for 
each of the wards included in the study. 

Procedure 

The safety survey will be given to patients by an appro- 
priate member of the clinical team or an administrator 
responsible for compiling discharge information, for 
example, discharge coordinator or ward clerk. Patients 
will be given a letter of invitation to the study, the safety 
survey and an evaluation form. The evaluation form will 
invite patients to evaluate aspects of the safety survey, 
including its relevance to their own experiences of 
safety, its ease of use and its helpfulness in educating 
them about patient safety. The forms will be used to 
guide the ongoing development of the safety survey. 
Patients will also be given a prepaid addressed envelope, 
a technique which has been shown to improve response 
rates to surveys. Those distributing the safety survey 
will be asked to prompt the patient to complete and 
return the safety survey. 

Participants will opt-in on completion and return of 
the safety survey and/ or an evaluation form. The option 
to return either is designed to reduce bias from those 
who evaluate the safety survey negatively or do not wish 
to complete it. Patients' family members or carers will 
be encouraged to assist the patients to complete the 
survey where applicable, or to complete it on their 
behalf. 

Each return envelope will have a unique identifying 
number which will be used to identify the ward that the 



patient was discharged from. Owing to the potentially 
sensitive nature of the topic, patients will have the 
option of returning the safety survey anonymously, and 
the identifying number will not be able to be used to 
identify individual patients. 

Analysis 

Descriptive and inferential statistical analysis will deter- 
mine if a relationship exists between patient experiences 
of safety and the other indicators and measures of 
quality and safety (Datix reports, safety thermometer 
data, readmissions, length of stay). One-way 
between-group analysis of variance will be used to 
compare response rates between sites. Non-parametric 
tests (in particular Kruskal-Wallis test and Spearman's r) 
will be used to analyse differences and relationships in 
evaluation responses. Descriptive statistics will form a 
mapping process of the journey and admissions stages of 
the transfer, which will be used in component 3. 
Evaluations of the safety survey will be used to modify 
the reporting tool on a monthly basis to ensure it meets 
the needs of the patients. 

Component 2: patients' receptiveness to reporting 

experiences of safety 

Objective 

To determine response rates and investigate the recep- 
tiveness of patients to the reporting tool, including the 
applicability of the domains of safety measured. 

Method 

Semistructured interviews, incorporating appreciative 
and cognitive interview components, will be conducted 
with patients to investigate their experiences of safety in 
care transfers and their experiences of providing feed- 
back on their safety. Appreciative interviews will utilise 
the discover and dream stages of AI^^ to investigate 
experiences of, and ideas about, safety. Cognitive inter- 
views will involve inviting interviewees to describe their 
thought processes in response to survey questionnaires, 
in order to identify any potential misunderstandings or 
other problems with those questionnaires; such inter- 
views have proven useful in validating and improving 
survey questionnaires in healthcare settings. The 
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interviews will be supplemented by data on response 
rates and evaluation forms. 

Interviews sample 

Interviews will be conducted with patients from each 
ward included in the study (n=36). A representative sam- 
pling framework will be used to identify patients who 
reported a range of experiences of safety were trans- 
ported by different means and arrived or were admitted 
to different organisations. The inclusion criteria for 
interviews include: 

► Able to give informed consent 

► Aged 18 or above 

► Able to speak English 

Procedure 

The interview questions will be structured into four 
themes: general health questions, general safety ques- 
tions, care transfer questions and safety survey questions. 
The general health questions will explore healthcare 
experiences from the patients' perspective and the 
general safety questions will explore how safety is under- 
stood and their experiences of safety. The care transfer 
questions will allow for further discussion of the answers 
to the general safety questions, applied to care transfers 
specifically. Finally, the safety survey questions will 
explore the patients' perspectives on the survey, includ- 
ing the applicability of the questions to their experiences 
and why they chose their answers. The questions will 
also focus on barriers and enablers to providing useful 
feedback on their own safety within care transfers. The 
patient interview schedule will be refined iteratively 
throughout data collection. 

Analysis 

Once each interview is complete it will be transcribed 
verbatim, then coded and analysed systematically using 
qualitative analysis software. Thematic analysis will be 
used, which is flexible enough to allow for new themes 
to emerge. The patient interviews and healthcare pro- 
fessional interviews (discussed below) will be analysed 
independently of each other. Response rates will be 
compared between wards, allowing for analysis of non- 
response bias. Planning for this before the data collec- 
tion commences is considered the best practice 
when conducting surveys within healthcare settings. 
Evaluation forms will be compared with responses on 
the safety survey using non-parametric statistical tests 
and descriptive statistics, and feedback will be used to 
iteratively modify the safety surveys on a monthly basis. 

Component 3: quality improvement using patient 

experiences of safety 

Objective 

Investigate the engagement and responsiveness of 
healthcare teams to the reporting tools and reports of 
safety, and the promotion of organisational learning. 



Method 

Semistructured interviews will be conducted with health- 
care professionals who were involved in the transfer of 
patients or who received the patient feedback. 

Sample 

Four healthcare professionals from each of the included 
wards, including the ward manager, patient safety lead 
(where in post), discharge coordinator (where in post) 
and other ward-based staff involved in care transfer 
(n=60), will be invited to participate in interviews or 
focus groups during the period of study. These partici- 
pants will meet the following inclusion criteria: 

► Work on one of the included wards during the 
period where safety surveys are distributed, where: 

- They are responsible for managing the ward, or 

- They have been involved in distributing the safety 
survey, or 

- They have responsibility for discharging patients. 

Healthcare professionals (n=15) from other organisa- 
tions (eg, ambulance services, nursing homes) involved 
in the journey or arrival/admission process of the care 
transfer, identified via the mapping process, will also be 
interviewed. The inclusion criterion for these partici- 
pants is: 

► Have responsibility for the management of patients 
or services relating to the transfer of the patient. 

Procedure 

The interview questions will be structured into three 
themes: general questions, general patient safety ques- 
tions and questions about safety survey feedback. The 
general questions will enquire about professional back- 
ground, current role and length of service in their 
current role and healthcare setting. The general patient 
safety questions will focus on understandings of patient 
safety, their perceptions of patient involvement in safety 
and the role of patients in reporting experiences of 
safety. The questions relating to the safety survey feed- 
back will investigate how much contact they had with the 
feedback, how the feedback has been used in practice, 
including the relevance and appropriateness of informa- 
tion provided, and the barriers or enablers to using the 
feedback to learn about patients' perceptions of safety 
and improve services. This section will also contain the 
cognitive interview component, where participants will 
be asked how they interpret the domains of safety in the 
survey. The healthcare professional interview schedule 
will be refined iteratively throughout data collection. 

Analysis 

Once each interview is complete, it will be transcribed 
verbatim, then coded and analysed systematically using 
qualitative analysis software. Thematic analysis will be 
used, which is flexible enough to allow for new themes 
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to emerge. 
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Mixed methods analysis 

Once data collection is complete across all objectives, 
mixed methods analysis will be conducted to provide a 
holistic meta-analysis. This analysis will consist of triangu- 
lating the findings in a convergence coding matrix, 
which displays findings fi:'om each component on the 
same page.^^ The matrix will allow for an analysis of 
(dis) agreements, partial (dis) agreements or silences 
across the different components of the study, resulting 
in meta-themes. 

This mixed methods analysis will provide a much 
deeper understanding of patient reporting of safety in 
care transfers than would have been possible if analysing 
the components in isolation. Case studies, underpinned 
by AI and combining the data together, will be devel- 
oped to provide examples of best practice, relating to 
how patients are currently made to feel safe, or how the 
feedback has been used to improve safety and experi- 
ences of safety. 

Study management 

The study was designed with input from patient repre- 
sentatives from the Patient, Carer and Public 
Engagement network at the former North East Strategic 
Health Authority. The Patient, Carer and Public 
Engagement network was part of the Safer Care North 
East programme of work, where the safety survey was 
developed. One member of the network, along with two 
other patient representatives, will be part of an advisory 
group to provide direction and guidance throughout 
the study. Other members of the advisory group will 
include two healthcare professionals responsible for 
safety and quality at the included NHS Trusts, independ- 
ent patient safety experts, the research team and senior 
healthcare professionals with expertise in healthcare 
policy. 

ETHICS AND DISSEMINATION 

Patient feedback received via the safety survey will be dis- 
seminated regularly to the healthcare teams and organi- 
sations involved in the study, in line with the quality 
improvement strategy, as stated in the study design 
section. Respondents will have the opportunity to 
request at the time of returning the survey a summary of 
the findings, which will be provided at the end of the 
study. The findings will also be published in peer- 
reviewed journals and at academic and health services 
conferences. 

DISCUSSION 

This paper has presented the background, methodology 
and methods of a large scale, multisite research project 
investigating the feasibility for patients to provide feed- 
back on their experiences of safety relating to their care 
transfer. As identified earlier, there is an increasing 
emphasis on the need for patients to be involved in 
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their own safety, highlighted by the recent events 



and subsequent enquiries at Mid-Staffordshire NHS 
Foundation Trust. This need can be addressed 

through patient reporting of safety concerns or inci- 
dents,^^ so that organisations can learn from the patient 
perspective. This study will address that need in the 
context of care transfers. 

Surveys are the most common method of soliciting 
patient reports of safety,^^ although there has been 
little research into how the results can lead to organisa- 
tional learning and quality and safety improvements. In 
settings other than patient safety, it has been identified 
that if used correctly, patient feedback can lead to 
improvements in the quality of care delivered,^^ 
although this does not occur as often as it should.^^ 

This study will build on this knowledge base by closing 
the gap between patients being involved in traditional 
incident reporting and the universal invitation for 
patients to provide feedback on their experiences of 
safety. This will also allow for the investigation of how 
patient feedback on safety can instigate quality improve- 
ments within multiple healthcare providers when 
patients' care crosses healthcare boundaries: a time 
when patients are at particularly high risk of experien- 
cing safety incidents.^ ^ Depending on the outcomes 
of the study, such as whether patient feedback on their 
experiences of safety can lead to improvements and how 
this feedback relates to other measures and indicators of 
quality and safety, there is potential for this feedback to 
become routinely collected data. 

As with other studies on patient involvement in 
safety,"^^ there are a number of risks to the study which 
can be broadly categorised into patient engagement and 
healthcare professional engagement. While evidence 
suggests that patients can be involved in their safety 
when willing and able,^^ the majority of this research 
has been conducted within single healthcare settings 
such as a hospital, and transferability of findings to care 
transfers is unknown. The distribution of the reporting 
tool during discharge, alongside other discharge docu- 
mentation, has the potential to result in information 
overload among patients, which may reduce response 
rates. This may be further complicated as older patients 
often do not understand discharge information."^^ 
Proactive dialogue between the research team and health- 
care professionals can help to mitigate this by encouraging 
the healthcare professionals to highlight the purpose of 
the survey to patients, thus encouraging dialogue around 
discharge information. The potential for reduced 
response rates will be further mitigated by distributing the 
survey universally, although this does not entirely remove 
the risk that data collected does not reflect the whole 
population being surveyed, but only those who are able 
and willing to respond. As with other patient involvement 
in safety research,"^^ the research team acknowledges that 
ultimate responsibility for patients' safety remains with the 
healthcare teams, and the safety feedback is meant to sup- 
plement rather than replace other measures and indica- 
tors of quality and safety. 
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In a similar manner, the patient safety surveys are not 
a means to quality improvement alone, but instead are 
part of a larger process of organisational learning and 
continuous quality improvement, which incorporates 
feedback loops and the constant analysis of data. 
Consequently, and as the research team will not be 
imposing themselves on the healthcare professionals 
in the sense of active encouragement of team meet- 
ings or having a constant presence within their teams, 
it is possible that the feedback will be overlooked or 
ignored. This risk can be mitigated by including pro- 
active dialogue between the research team, healthcare 
teams and the patient safety managers within the 
research sites outside of the feedback periods, discuss- 
ing inside and outside the interviews any issues that 
arise. Understanding any barriers to engagement is 
also important to uptake, and this dialogue should 
help to improve the ecological validity of the safety 
surveys. 

The authors intend to demonstrate how, or if, rou- 
tinely collected data on patient experiences of safety is 
linked to other measures and indicators of quality and 
safety, much like patient incident reporting shares some 
similarities with healthcare professional incident report- 
ing. The investigation of the processes involved in 
using and learning from this feedback will provide a 
greater understanding of how improvements can be 
made to quality and safety as a result of patient feed- 
back, within the context of care transfers. 
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